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ERROR  BOUNDS  FOR  FINITE-DIFFERENCE  METHODS  FOR 
RUDIN  OSHER  FATEMI  IMAGE  SMOOTHING* 

JINGYUE  WANGt  AND  BRADLEY  J.  LUCIERt 

Abstract.  We  bound  the  difference  between  the  solution  to  the  continuous  Rudin-Osher— Fatemi 
image  smoothing  model  and  the  solutions  to  various  finite-difference  approximations  to  this  model. 
These  bounds  apply  to  “typical”  images,  i.e.,  images  with  edges  or  with  fractal  structure.  These  are 
the  first  bounds  on  the  error  in  numerical  methods  for  ROF  smoothing. 

Key  words.  Total  variation,  bounded  variation,  variational  problems,  finite-difference  methods, 
image  processing. 

AMS  subject  classifications.  65N06,  65N12,  94A08 

1.  Introduction.  Image  noise  removal  based  on  total  variation  smoothing  was 
introduced  by  Rudin,  Osher,  and  Fatemi  in  [13].  Under  this  ROF  model,  one  supposes 
a  “true”  image  /  defined  on  O  =  [0,1]^  and  a  “corrupted”  image  g  derived  from  / 
(by  adding  noise,  etc.)  with  ||/  —  In  an  attempt  to  reconstruct  /  from 

g,  one  calculates  a  “smoothed”  image  u  that  minimizes 

iL'lBV(n)  =  J  \Dv\  subject  to  the  constraint  jjz;  —  <  cr^.  (1.1) 

(Precise  definitions  are  given  later.)  We  deal  with  the  equivalent  problem:  If  we 
calculate  /,  the  average  of  /  on  O,  then  for  any  a  with 

^^<ll/-/lb(n) 

there  exists  a  unique  A  >  0  such  that  the  minimizer  of  (1.1)  is  the  minimizer  u  of  the 
functional 


^('^)  =  “  5'llb(n)  +  |?^|BV(n)-  (1-2) 

Here  A  is  a  positive  parameter  that  balances  the  relative  importance  of  the  smooth¬ 
ness  of  the  minimizer  (important  when  A  is  large)  and  the  L^(H)  distance  between 
the  minimizer  and  the  initial  data  (important  when  A  is  small).  About  the  same 
time,  Bouman  and  Sauer  [1]  proposed  a  discrete  version  of  (1.2)  in  the  context  of 
tomography. 

Practically  one  discretizes  E{-)  to  compute  the  minimizer  of  the  discrete  functional 
Eh{-)-  We  assume  the  discrete  corrupted  image  g^  of  resolution  N  x  N  {N  =  1/h) 
is  simply  the  piecewise  constant  projection  of  the  continuous  corrupted  image  g,  and 
define  the  discrete  functional 

Eh{v>^)  =  (1.3) 


*This  work  was  partially  supported  by  the  Office  of  Naval  Research,  Contract  N00014-91-J-1152, 
and  the  Institute  for  Mathematics  and  its  Applications,  the  University  of  Minnesota. 

^Department  of  Mathematics,  University  of  Georgia,  Athens,  Georgia  30602 
( j  wangSmath . uga . edu) . 

^Department  of  Mathematics,  Purdue  University,  West  Lafayette,  Indiana  47907-2067 
(lucierOmath . purdue . edu) . 
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where  is  a  discretized  total  variation.  The  most-commonly  used  Jh  is  the  discrete 
variation  J_|_+  used  in  [13] 


J++{v^) 


v>l) 


2 


\  ^ 


2 


h\ 


EfRcient  algorithms  have  been  developed  to  compute  the  discrete  minimizer([2],  [6], 

[3],  [5]).  ^ 

In  this  paper,  we  study  the  relationship  between  the  minimizer  u  of  £’(•)  and 
the  discrete  minimizer  of  Eh{-).  It  is  well  known  that  Eh  T-converges  to  E  in 
L^.  As  a  direct  deduction  tends  to  m  in  Assuming  the  discrete  variation  Jh 
satisfies  certain  conditions  that  we  explain  later,  we  give  a  bound  of  the  norm  of 
the  difference  between  u  and  in  Theorem  4.2  in  Section  4. 

Because  the  ROF  model  is  often  applied  to  images,  an  analysis  of  the  error  be¬ 
tween  solutions  of  discrete  approximations  and  the  solution  of  the  continuous  model 
itself  should  apply  to  functions  modelling  images.  “Typical”  natural  images  have  lit¬ 
tle  smoothness,  because  of  intensity  discontinuities  at  the  edges  of  objects  and  the 
fractal  structure  of  many  objects  themselves  (the  leaves  in  a  tree,  hair,  etc.).  Our 
results  apply  to  functions  in  the  Lipschitz  spaces  Lip(a,  L^(0)),  which  contain  func¬ 
tions  with,  roughly  speaking,  a  “derivatives”  in  L‘^{Vi).  Here  0  <  a  <  1/2  for  “images 
with  edges”:  /  G  BV(H)  n  implies  /  G  Lip(l/2,  L^(r2)),  while  functions  with 

fractal  structure  usually  have  a  <  1I2,  see  [7]. 

Our  convergence  results  in  Section  4  are  proved  for  (1.3)  with  Jh  =  J*,  a  discrete 
variation  obtained  by  symmetrizing  J++.  Nonetheless,  our  approach  is  quite  general, 
and  in  Section  5  we  obtain  the  same  results  for  J[/,  an  “upwind”  discrete  variation 
formulated  in  [12].  We  remark  that  an  iterative  method  for  minimizing  (1.3)  with 
Jh  =  Ju  was  given  in  [5]. 

While  the  ROF  model  has  proved  to  be  tremendously  influential,  and  has  been 
the  base  of  further  algorithms  in  image  processing,  we  know  of  no  other  results  that 
bound  the  difference  between  the  solutions  of  the  continuous  problems  and  its  finite- 
difference  approximations.  A  finite  element  method  applied  to  the  time-dependent 
gradient  descent  problem  associated  with  (1.2)  was  studied  in  [10];  we  note  that  their 
Theorem  4  requires  the  initial  data  uq  to  have  two  continuous  derivatives  on  Q  so  it 
does  not  apply  to  “typical”  natural  images  with  edges. 

The  rest  of  this  section  introduces  the  notation  for,  and  basic  properties  of,  oper¬ 
ators  and  functionals  on  continuous  and  discrete  functions.  In  Section  2  we  compare 
discrete  and  continuous  variational  functionals.  In  Section  3  we  note  some  properties 
of  the  minimizers  of  £’(•)  and  Eh{-)  that  we  use  in  Section  4  to  first  bound  the  discrete 
and  continuous  functionals  at  their  respective  minimizers  and  then  to  bound  the 
difference  between  the  discrete  and  continuous  minimizers  themselves.  In  Section  5, 
we  prove  a  number  of  lemmas  for  the  “upwind”  discretization  of  the  BV  semi-norm 
that  allows  us  to  prove  similar  error  bounds  for  the  discrete  minimizer  of  the  “up¬ 
wind”  scheme.  Finally,  Section  6  summarizes  our  results  and  points  to  variations  that 
appear  elsewhere. 

1.1.  Basic  notations.  We  consider  the  usual  Lp(H)  spaces  on  H  :=  [0, 1]^  C  K.^, 
with 

lkllL.(n)  := 


2 


for  1  <  p  <  oo  and 


lkllL”(n)  =  ess  sup|7;(a;)|. 

We  consider  the  discrete  set  to  be  the  set  of  all  pairs  i  =  (*1,12)  G  Z^,  Z  the 
integers,  with  0  <  ^1,^2  <  N,  h  =  1/N,  and  we  refer  to  functions  defined  on  as 
discrete  functions.  So  for  discrete  functions  we  define  the  discrete 

norms 

\\v''\\LP{n>^)  •=  (X!  for  1  <  p  <  00 

\en'‘  ^ 


and 


lk^llL-(n'‘)  =  niax|uf|. 

In  later  definitions,  we  assume  the  reader  will  apply  the  usual  modifications  when 
p  =  00. 

We  define  the  translation  operator  for  discrete  functions  by 
{Tiiv^))^  :=  'u'Yf  for  any  £  =  (£i,£2)  G 
To  measure  the  size  of  a  translation,  we  introduce 

|£|  =  max(|£i|,  l^aD- 


Similarly, 

{Ttv)[x)  =  v{x  +  r)  for  any  r  =  (n,  T2)  G 
and,  for  translations,  we  set 

|t|  =  max(|Ti|,  \t2\). 

We  often  need  to  extend  v  £  and  to  all  of  and  1?, 

respectively;  we  denote  the  extensions  by  Extu  and  Ext?iU^.  For  v  G  we  use 

the  following  procedure.  First, 

Extr!(a;)  =  v{x)^  x  gV.. 

We  then  reflect  horizontally  across  the  line  xi  =  1, 

Ext  v(xi,X2)  =  Ext  v(2  —  xi,  X2),  1  <  a;i  <  2,  0  <  X2  <  1, 

and  reflect  again  vertically  across  the  line  a;2  =  1, 

Ext  t!(xi,  0:2)  =  Ext  (xi,  2  —  12),  0  <  xi  <  2,  1  <  a;2  <  2. 

Having  defined  Extz;  on  212,  we  then  extend  Extz;  periodically  on  all  of 

We  use  a  similar  constructions  for  discrete  functions  v^.  First  we  extend  to 

2n^  :=  {i  =  (2i,i2)  G  Z^  I  0  <  ii,i2  <  2N} 
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as  follows: 


Ext/i  v!^  =  Vi  ,  i  G 

then  we  reflect  horizontally 

Ext/i  =  Ext/i  N  <ii<2N,  0<i2<N, 

and  then  vertically 

Exth  =  Ext,,  z;(‘^_2Ar-ii-i)>  0  <  ii  <  2fV,  N  <  i2  <  2N. 

Now  that  Ext,,  is  defined  on  212^,  we  extend  it  periodically  to  all  of  Z^.  Note  that 
with  this  definition,  the  value  of  Ext,,  at  any  point  immediately  “outside”  is 
the  same  as  the  value  of  at  the  closest  point  “inside” 

For  V  €  L^iVL)  we  define  the  (first-order)  LP{H)  modulus  of  smoothness  by 


‘v{v,t)LP(Q)  =  sup 


|T|<t  \  ./ai,rc+rGr2 


\v{x  -I-  r)  —  v{x)\^  dx 


We  also  define 


a;(Extz;,t)LP(2n)  ;=  sup  ||7;  Extw  -  Extz;||LP(2n)- 

t6R2,  |T|<t 

The  Lipschitz  spaces  Lip(a,  LP(fl))  consist  of  all  functions  v  for  which 

|i^|Lip(a,LP(a))  :=  supt““u;('u,t)Lp(n)  <  oo; 

t>o 

we  set 

ll^^l|Lip(a.LP(a))  :=  ||w||LP(n)  +  |w|Lip(a.LP(n))- 

We  also  need  a  discrete  modulus  of  smoothness.  The  discrete  modulus  of 

smoothness  is 


w(u^,m)ip(n^)  :=  sup  ^  \v^+e  -  v'll^ 


For  Ext,,  we  define  similarly 

a;(Ext/i7;^,m)j^p(2a'^)  =  sup  ||T^  Ext/,  t;'"  -  Ext^ 

'£\<m 


We  have  the  following  relationship  between  moduli  of  smoothness  and  our  exten¬ 
sion  operators. 

Lemma  1.1  (Whitney  extension).  For  all  1  <  p  <  oo  there  exists  a  constant  C 
such  that  for  all  v  €  LP(fl)  and  G 

||7;Extu  -  Extv||LP(2n)  <  ^^(u,  |Tl)ip(Q)  t  G  (1.4) 

and 

||T,Ext„u'^-Ext„i;'‘||iP(20^)  <CL^(^;M£|)iP(n.)  £  G  Z^  (1.5) 
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Moreover,  for  all  positive  i  G  M,  m  £  Z  we  have 


and 


uj{Extv,t)LPt^2n)  <  Cuj{v,t)LP{n) 


(1.6) 


a;(Ext/iti^,m)ip(2n'*)  <  Cuj{v^ ,Tn)LP(iih). 


(1.7) 


Proof.  Inequalities  (1.4)  and  (1.6)  follow  because  our  extension  satisfies  the  Whit¬ 
ney  extension  theorem  [8],  page  182.  Inequalities  (1.5)  and  (1.7)  are  a  form  of  a  dis¬ 
crete  Whitney  extension  theorem  that  can  be  proved  along  the  lines  of  the  proof  of 
the  Whitney  extension  theorem  given  in  [8].  □ 

1.2.  Variation  functionals.  The  variation  of  a  function  v  £  L^(fl)  is  defined 
as  follows.  We  consider  functions  (j)  in  the  space  of  functions  from  to  with 
compact  support,  i.e.,  [Cq)!!)]^.  The  variation  of  a  function  v  £  L^{n)  is  then  defined 
to  be 


|i'|BV(n)  :=  /  := 

Jn 


sup  /  uV  ■  (j). 

[Cq  (n)]2,  |^|<l  pointwise  O 


We  note  that  if  v  is  in  the  Sobolev  space  so  that  its  first  distributional 

derivatives  are  in  L^(0),  then 


klBV(O)  =  /  |Vw|. 
Jo. 


We  need  discrete  analogues  of  the  variation  of  a  function.  For  ©  and  0  indepen¬ 
dently  taking  values  in  the  set  {+,  — }  and  any  discrete  function  we  define 


ieo'* 


/ Ext/i  W0(i_o)  “  W  \  ( We(o.i)  “  Ext/i  u'’ 


hs  2 


[■ 


(1.8) 


We  note  that  the  sum  is  over  i  €  and  Ext^  =  v!f  for  all  i  € 

Having  defined  J++{v^),  J-| _ (v^),  J _ and  J__(u^),  we  define  for  any  non¬ 

negative  a,  b,  c,  and  d  with  a  +  6  +  c  +  d=  l 

Jhiv^)  =  a  J++{v^)  +  &  J+_(u^)  +  c  J_+(u'')  +  dJ _ (u^)  (1.9) 

and  define  the  special  “isotropic”  discrete  variation 

JM)  ■■=  +  ^+-(«")  + 

J*  is  invariant  under  rotations  of  by  90  degrees,  or  under  horizontal  or  vertical 
reflections. 

At  times  we  consider  discrete  variational  functionals  for  discrete  functions  defined 
on  217^;  for  these  purposes  we  denote  by  J2q{v^)  the  discrete  variation  defined  in 
(1.8)  and  (Ext/i  v^)  the  corresponding  sum  over  217^;  similarly  we  write 


Jh  (^'^)  =  Jh{v^)  and  =  J*(u^) 
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and  we  use  the  notation  (Ext/i  for 

a  (Ext/j  +  b  (Extft  v^)  +  c  (Ext?i  v^)  +  d  J^_  (Ext/i  v^) 

and  Jl^’'  {^y±h  v^)  for  the  corresponding  sum  with  a  =  b  =  c=  d=  1/4. 

We  have  the  following  relationships  between  continuous  and  discrete  variations  of 
functions  and  the  continuous  and  discrete  extension  operators. 

Lemma  1.2  (TV  symmetry).  For  any  discrete  function  v^, 

4%"  (Exk  v^)  =  4jf{v>^).  (1.10) 

Thus,  we  have 

=  Ajf  {v’^)  (1.11) 

and  for  any  i  dT? 

"(T^Ext^T;'*)  =  (1.12) 

Similarly,  for  any  v  £  BV(fl),  we  have 

I  Extu|Bv(2n)  =  4|i;|bv(0)-  (1-13) 


Proof.  Relation  (1.10)  follows  because  we  construct  ExthV^  by  reflection  across 
the  boundaries  of  and,  for  example,  J+_|_(Extr;^)  on  the  lower-left  quadrant  of 

2fl^  is  equal  to  J _ (Extu^)  on  the  upper  right  quadrant  of  2fl^. 

The  next  two  relations  follow  immediately  from  (1.10). 

Relation  (1.13)  is  a  consequence  of  the  fact  that  we  introduce  no  variation  in 
Ext  V  along  the  original  boundary  of  by  reflecting  v  across  that  boundary.  □ 

We  also  define  a  discrete  “anisotropic”  variation  that  is  analogous  to  the  W^4(fj) 
Sobolev  seminorm: 


Ext/.  u(Y(bo) 


h 


Ext/, 


Ext/j  1)  -  Ext/, 


(1.14) 


Because,  for  nonnegative  x., 

n  /  n  \  2  n 

•^EIS) 

i—1  ^i—1  ^  i—1 


b^lwcqn'*)  is  equivalent  to  any  (take  n  =  2)  and,  a  fortiori,  to  any  particular 

J0e(z/^).  Thus  we  have  the  following  lemma. 

Lemma  1.3  (Discrete  TV  equivalence).  J/.  is  equivalent  to  \  ■  To  be 

precise,  there  exist  positive  constants  Ci  and  C2,  such  that  for  any  discrete  function 


(1.16) 
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For  some  intermediate  estimates  we  need  second-order  continuous  and  discrete 
seminorms,  so  we  define  for  v  in  the  Sobolev  space  with  periodic  boundary 

conditions  (i.e.,  treating  as  a  torus) 


klw2.i(2n)  =  /  \Dlv\  +  \Dlv\. 
J2n 


and  for  periodic  discrete  functions  on 


ie2n'* 


/l2 


'f+(o,i) 


(1.17) 


/l2 


Note  that  these  seminorms  do  not  include  “cross”  derivatives  or  differences,  but  we 
do  not  need  these  in  our  estimates. 

Lemma  1.4  (TV  difference).  For  any  two  discrete  functionals  Ji^q  and  J©'e', 
and  any  discrete  funetion  we  have 

(1.18) 


Proof.  First  we  consider  |J+_|_(u^)  —  _ The  quantities  summed  in  (1.8) 

are  the  norms  of  two-vectors  of  divided  differences,  which  we  choose  to  write  in  the 
following  way. 

|J++(^")- J+_(z;'‘)| 


E 


1  /  Ext/iw(Y(^  p)  -  Ext/iuf 
h  I  ExUu(Y(o_^)  -Fx.ihv'f 


1  /  Ext?,  -  Ext/,  v’f 

h  I  (-l)(Ext/,E(o,i)  -Ext/,i;f) 


Ext/,  -  Ext/,  uf 

(-l)(Ext/,uf_(o  -Ext/iuf) 


Ext/,  -  Ext/, 

h  ,  „.h\ 


Ext/,  <+(0  1)  -  2  Ext/,  <  -h  Ext/,  <_(o+ 


(-l)(Ext/,  <_(o,i)  -  Ext/,  O 


-E 

iGO** 

<  -  E 

<  -  E 
=  -  E 

iGO'* 

<  ft, I  Ext/,  U  li4/^U(2Qfc). 

Identical  arguments  work  to  bound  \J++{v^)  —  J _ i-(^^)|j  \J _ (^^)  ~  _ (i^^)Ij  and 


Ext/,  <+(+0)  -  Ext/,  < 
Ext/,  <+(0  1)  -Ext/,< 

Ext/,  <+(+0)  -  Ext/,  < 
Ext/,  <+(0+)  -  Ext/,  < 
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\J--{v^)  —  J _ Finally  we  have 


1 


zGO'* 


4i: 


zGO'* 

+ 


Ext/i  “  2  Extft  v2  +  Ext/i  ’ 

Ext/,  T^f+(o,i)  -  2  Ext/,  +  Ext/,  T^f_(o,i)  j 

0 

Ext/,  ^^'V(o,i)  -  2  Ext/,  i/f  +  Ext/, 

Ext/,  “  2  Ext/,  i/f  +  Ext/, 

0 


— /i|  Ext/,  Iw^’i(2n'>)- 


1.3.  Projectors,  injectors,  and  smoothing  operators.  We  define  the  piece- 
wise  constant  injector  of  discrete  functions  into 


{Ihv'^)[x)  =  for  a;  6  Oi, 


where 


n,-=h(n  +  i)  (1.19) 

Later  we  define  an  injector  into  a  space  of  continuous,  piecewise  linear  functions. 

We  also  consider  the  piecewise  constant  projector  of  u  €  onto  the  space  of 

discrete  functions,  defined  by 

{Phv)i  =  f  V, 

l“i|  Jcii 

where  Ifl/I  is  the  measure  of 

With  these  definitions,  we  collect  some  well-known  results  into  the  following 
lemma. 

Lemma  1.5  (Injector  and  projector).  There  exists  a  constant  C  such  that  for  all 
V  €  LP(n)  and  G  1  <  p  <  oo,  the  following  properties  hold. 

For  the  projector  P/, 


\\Phv\\Li’{Q.f^)  <  K’  iP(n); 

(1.20) 

and 

cj(P/,v,TO)ip(Qh)  <  Cu!{v,mh)LP{Q)- 

(1.21) 

For  the  injector  //, 

Ik^lUrCn'*)  =  \\hv^\\LP(n)] 

(1.22) 

and 

a;(//,u'",m/i)ip(o)  <  Cu}{v’^ ,m) LP^^hy 

(1.23) 

We  also  have 

\\v  -  IhPhv\\LP(n)  <Cui{v,h)LP:^Qy 

(1.24) 

Finally,  we  have  for  any  periodic  v  S 

\^hv\^r^n^2n>')  —  I'*^lvy2,i(2n)  ■ 


(1.25) 


Proof.  The  relation  (1-22)  follows  from  definitions.  Jensen’s  inequality  implies 
(1.20)  and  (1.21).  Property  (1.23)  follows  from  the  definitions  of  discrete  and  contin¬ 
uous  modulus  of  continuity  and  the  fact  that  for  any  1  <  p  <  oo  and  r  >  1  there 
exists  a  C  such  that  for  alH  >  0 


w(/,rt)ip(0)  <  Cuj{f,t)LP{n)- 

We  note  (1.24)  is  a  special  case  of  a  general  bound  for  the  error  in  spline  approxima¬ 
tion;  see  [8],  Theorem  7.3,  page  225. 

To  prove  (1.25),  we  deal  with  the  differences  in  the  horizontal  direction. 


E 

iG2n^ 

=  T  - 

^  h 


{Phv)i+(^ip)  —  2{Phv)i  +  (P?i)nj_(i  0) 


1620'* 


iPhv)^+(lp)  -  {Phv)i  {Phv)i  -  {Phv)i-{lfi) 


=  y  - 


1620'* 


h  h 

[(n(a;  +  h,y)-  v{x,  y))  -  {v{x,  y)  -  v{x  -  h,  ?/))]  dx  dy 


=  y.  ^  [  [  [Div{x +  t,y)  -  Div{x  +  t  -  h,y)]  dtdx  dy 
1620'* 

=  f  [  [  Diivix  +  t  +  s,y)  ds  dt  dx  dy 

^  -Jo  J-h 

<  /  iPiii'l  dx  dy  (exchange  the  order  of  integration  and  sum  over  i) 

J2Q. 


Arguing  similarly  in  the  vertical  direction,  we  see  that  (1-25)  holds.  □ 

We  have  need  of  another  map  taking  S  Lf{Vl^)  to  in  the  form  of  a 

piecewise  linear  interpolant  of  the  discrete  values  of  vf .  To  this  end,  let  (p  be  the  box 
spline  function  whose  support  is  the  hexagon  D  in  Figure  1.1  with  p  being  linear  on 
each  triangle  in  Figure  1.1  and 


1,  ^  =  (0,0) 

0,  i  (0, 0),  i  £ 


We  dilate  and  translate  p  to  obtain  the  function 

We  see  that  supp p'f  is  D  dilated  by  h  and  translated  by  (*+(5,5))^- 
We  define  the  interpolant  Int  by 


(1.26) 


Intn^  =  Exthv'fcpi. 

i6Z2 
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Fig.  1.1.  D,  the  support  of  4> 


We  then  have  the  following  lemma. 

Lemma  1.6  (Piecewise  linear  injector).  For  any  be  in  we  have 

Intn^lBv(n)  =  (1-27) 

Additionally,  there  exists  a  constant  C  such  that  for  all  discrete  functions 

\\IhV^  -  Intr!^||i2(Q)  <  Cu}{v^,  l)L2(ofc).  (1-28) 


Proof.  The  proof  of  (1.27)  is  just  a  calculation,  which  we  leave  to  the  reader.  (The 
J++  terms  come  from  triangles  with  the  orientation  of  the  triangle  in  the  upper-right 

quadrant  of  Figure  1.1,  and  the  J _ terms  come  from  triangles  with  the  orientation 

of  the  triangle  in  the  lower-left  quadrant  of  Figure  1.1.) 

To  prove  (1.28),  we  consider  each  subsquare  where  IhV^  takes  the  value  v!f. 
The  definition  of  fli  is  in  (1.19).  We  construct  the  constant  function 

h  hih 

j'en'* 


which  equals  IhV^  on  and  we  set 

l'  =  {i  I  supp  (/>(“/  intersects  nontrivially}. 
There  are  precisely  seven  elements  in  I' .  Then 


Intu'"  = 


ZK'---.'! 

i'Gl' 


< 


since  \(j)'l,{x)\  <  1 


i'e/' 


For  one  of  the  “diagonal”  terms  we  have 


|?^,+(_i.i)  -  Vi  I  <  2(|u,+(_bi)  -  ?^i+(-i,o)l  +  ki+(-i.o)  -  I  ); 
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a  similar  bound  exists  for  1^- 

Thus,  there  exists  a  C  such  that 


j  -  IhV^\^  =  Y]  [  \lntv^-hvY 

Jq 


<CY  {K(1,0)  -  vY  +  K(0,1)  -  ri 


so  there  exists  another  constant  C  such  that 

II  Int?;'*  -  //iV^||i2(n)  <  C{\\T(q  iY  “  ^^11^2(0^)  +  ||T’(i,o)i’^  -  '*^^11^2(0^)) 

<  CloY,  l)_L2(Qh) 


□ 

We  need  both  continuous  and  discrete  smoothing  operators,  which  we  define  as 
follows.  Assume  that  g{x)  is  a  a  fixed  nonnegative,  rotationally  symmetric,  function 
with  support  in  the  unit  disk;  further,  suppose  that  rj  is  C°°  and  has  integral  1.  For 
e  >  0  we  define  the  scaled  function 


77e(x)  :=  ^77(^), 

we  smooth  a  function  v  G  LP(f2),  1  <  p  <  oo,  by  computing 

{Sev){x)  :=  {rj^  *Extv){x)  =  /  r]^{x  —  y)  Extv{y)  dy,  a;  G 

aR2 

Our  discrete  smoothing  operator  is  defined  simply  as 

(2L  +  1)^ 

It’s  clear  from  these  definitions  that 

T^Sl  Ext/i  =  SlTi  Ext/i  and  Ext  v  =  S/Tt  Ext  v  (1-29) 

and  that  for  any  1  <  p  <  oo 

ll'S'Lr^^||LP(a».)  <  ||-S'Lu'*||ip(2n'*)  <  II  Ext/^  u''||ip(20f>)  =  4||?;'*||ip(oh)  (1.30) 

and 

||‘5ew||LP(n)  <  ||5<:u||LP(2n)  <  ||  Ext  v||iP(2n)  =  4||u||LP(n).  (1.31) 

For  these  continuous  and  discrete  smoothing  operators  we  have  the  following 
results. 

Lemma  1.7  (Smoothing  operators).  There  exists  a  constant  C  >  0  such  that  the 
following  inequalities  hold. 

For  all  V  G  LP{Tl),  p  >  1,  and  all  discrete  functions  v^,  we  have 

MSlv^)  <  Mv'^)  (1.32) 
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and 


l‘5ei’|BV(n)  <  klBV(n)- 


Similarly,  for  all  M,  t  >  0, 

w{Slv^ M)^2(Qh) 


and 


w(5eZ;,t)i2(Q)  <  C'w(z;,t)L2(Q). 


Furthermore, 


WSlv'^  -  ?;^||L2(Qh)  <  Cu;{v^,L)i^2(^Qh-j, 


and 


||5ei;  -  w||l2(q)  <  Cuj{v,  e)L2(Q). 


We  also  have 


|5eV|B/2,l(2n) 


klBV(n) 


and 


\Slv^ 


< 


C 


^(20'*)  ^  Lh 


(1.33) 

(1.34) 

(1.35) 

(1.36) 

(1.37) 

(1.38) 

(1.39) 


Proof.  Using  the  notation  and  results  of  Lemma  1.2,  because  J„  is  convex,  we 


have 


=  jf(SLv'')  =  \ff\SLv’') 


=  u 


2n'‘ 


4  *  \{2L  +  1)^ 


TiExthV^ 


1  1 

<  - 
-  4 


\e]<L 

■  h  , 


(2iTlF  S/“  ®  "«<.»*) 


For  the  next  inequality,  we  have 


|5eu|Bv(n)  =  ;|l‘5eu|Bv(2n)  <  ;^klBV(2n)  =  |^^|BV(n), 


since  it  is  clear  from  the  definition  of  |u|Bv(2a)  with  periodic  boundary  conditions 
that  |>Seu|Bv(2a)  ^  klBV(2n)  (throw  the  molliher  on  (f). 

The  two  inequalities  (1.34)  and  (1.35)  follow  from  the  definitions  of  and  5^ 
and  Lemma  1.1. 
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We  have 


\\Slv^ 


v'^Wlhq’')  <  \\Slv'" -F.xthv'"\\L'^(^2n>‘) 

{Ti  Ext/j  t 

\i\<L 


(2L  +  1)2 

<  - ^  llT^Ext/ii 

-  2L  +  1  2  II  ^ 

^  '  \(\<L 

<  a;(Ext/iW^,L)^2(2Qh) 

<  Cu}{v^,  L)i2(Qh). 


Ext/i  v^) 


^2(20'“) 


Ext,^7;'‘||i2(2afc) 


Similarly,  since  the  support  of  ?7e(x)  is  contained  in  the  ball  |x|  <  e, 


\\SeV  -  n||i2(n)  <  \\SeV  -  Extr;||i2(2Q) 

=  \\t]^  *  Extr;  -  Ext  r;||i2(2n) 

<  /  ??e(y)l|Extr;(- -y) -Extr;||i2(20)dr/ 

J2a 

<  Cuj{v,e)L^n)- 

The  last  line  follows  from  (1.4)  of  Lemma  1.1. 

The  bound  on  the  discrete  VF^’^(2n^)  semi-norm  is  a  typical  inverse  inequality; 
to  deal  with  the  differences  in  the  horizontal  direction, 

,.h  I  C!.„,h 


E 

ie2n'‘ 

=  E 

ie2n'‘ 


0) 


h2 


1 


=  E 

ie2n 


i2L  +  iy 


1 


E 

\t\<L 

E 

!^2|<i 


Ext,,  “  2  Ext/,  -b  Ext,,  ^^^+£-(1.0) 


/l2 


Extft  -  Ext,, 


h2 


/l2 


(sum  over  i\) 


-  E  (2L-bl)2  E  ^ 

ig2n'‘  '  '  K2|<i 


Ext,,  -  Extft 


h2 


Ext,,  -  Ext,, 


/l2 


< 


c 


(2L-b  l)/i 
<  ^\v 


E 

,€20'“ 


Extft  ^^^+(1^0)  -  Ext,, 


“  Lh  ^  Iivi’i(f2'*) 

For  the  bound  on  the  W‘^’^{2Q,)  semi-norm,  again  we  deal  with  derivatives  in  only 
one  direction.  We  prove 
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In  fact 


\DlSM  < 


[  \DlSev\  =  sup  [  {Dls^v)  (j) 

J2n  <pGC^{2n),  \<j>\<iJs.^ 

=  sup  [  (DiS^v)  Di{-(f)) 

<pGC^(2n),  |<^|<lJR2 

sup  /  Di{ri^  *F,xtv)  Di{—(j)) 


sup 


(Exti;)  Di{Di-q^  *  (/>); 


<pGC^{2n),  |<^|<lJR2 
note  that  all  but  the  first  of  these  integrals  are  over  R^.  Notice 


and  DiT]^  *  cj)  G  C^{2il‘^),  where 

:=  {x  I  dist(a;,  2?I)  <  e}, 


therefore 

f  \DlS,v\  <-  [  |i:>Extr;| 

J2Q.  £  J2n^ 

<  —  /  |Z?Extz;|  <  —  /  \Dv\ . 

e  Jq'  e  Jn 

where  fl'  =  {(x,  y)  \  |x|,  \y\  <  3}. 

The  same  result  holds  for 

□ 

2.  Relationships  between  discrete  and  continnons  variation  and  fnnc- 
tionals.  We  need  to  compare  continuous  and  discrete  variation  functionals,  so  we 
have  the  following  lemma. 

Lemma  2.1  (TV  bound).  There  exists  a  C  >  0  such  for  any  Jh  and  any  v  £ 

L\n) 


Jh{Phv)  <  klBV(a)  +  C'/i|  Ext  r!|w2,i(2n)  (2-1) 

and  for  any  defined  on 

|Intu'*|Bv(n)  <  Jh{v^)  +  Ch\Exthv'^\y^^2,i^^^^y  (2.2) 


Proof.  One  proves  the  second  inequality  simply  by  combining  (1.27)  and  (1.18). 
As  for  the  first  inequality,  the  left  hand  side  is  finite  for  v  £  L^(f2),  so  if  Extri  ^ 
lT^’^(2n),  we’re  done.  So  we  assume  that  Extu  £  lE^’^(2n)  and  we  prove  (2.1)  for 
Jh  =  =/++,  the  other  cases  being  the  same. 
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(2.3) 


We  denote  PhV  by  and  write 


\  ~  V  A  ,  . 


= 


Ext/,  ?;f+(o,i)  -  Ext/,  v’^ 


We  briefly  note  that  when  i  G  then  Ext/,  =  i/f  and  these  differences  are  zero 
if  i  +  (0, 1)  or  i  +  (1,  0)  are  outside  In  the  argument  that  follows,  we  write  v  for 
Ext  V. 

Then 


1 


Pii 


1  1 

^  1^*1  Jfi 


j  [v{x  +  h,y) -v{x,y)\dxdy  -  ^  j  Div  . 


The  integrand  of  the  first  integral  can  be  rewritten  as  an  integral  of  Div,  then  com¬ 
bining  these  two  integrals  and  once  again  rewriting  the  integrand  as  an  integral  of  the 
second  derivative  of  u,  we  have 


V+u'*  -  — 

^  *  /l2 


1 


Pi 


Div  =  —  [  (  [  Divix  +  t,y)  dt  —  hDiv{x,y)]  dx  dy 
dn,  ^Jo  ' 


1 


{Div{x  +  t,y)—  Div{x,  y))  dt  dx  dy 


Pi  Jo 


~r^  f  f  f  D?v{x  +  s,y)  ds  dt  dx  dy  . 

dn,  Jo  Jo 


Therefore 


V+u'*  =  — 

X  j^2 


f  Div  + —^  f  f  f  D\v{x  +  s,y)  ds  dt  dx  dy  . 
Jiii  Jo-i  Jo  Jo 


Similarly, 


1 


1 


r-h  ft 


a hJ 


D\v{x^  y  +  s)ds  dt  dx  dy  . 


Pi  JQi  Jo  Jo 

So  we  can  bound  the  norm  of  by 


|V-.?|  <  1 


/n, 

liii 


1 

IP 


In  Jo  fo  Eliu(a:  +  s,y)  dsdt  dx  dy 


JQi  Jo  Jo 

rh  rt 


In-  fo  fo  ^2v(x,  y  +  s)ds  dt  dx  dy 


(2.4) 


ph  pt 


'Qi  Jo  Jo 

p  ph  pt 


\DIv{x  -I-  s,2/)|  dsdtdxdy 


\D2v{x,  y  +  s)  \  ds  dt  dx  dy  . 


Pi  Jo  Jo 


(2.5) 
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The  last  line  follows  from  the  fact  that 


<  J  VP  +9'^ 


If 

l9 


by  Jensen’s  inequality,  and 


<  |a|  +  |6| . 


To  bound  the  discrete  total  variation  we  sum  (2.4)  over  all  indices  i  € 

with  weight  P  at  each  index.  We  obtain 


J_i_+(u^)  <  /  \Dv\+ei+e2, 
Jn 


where 


ei 


S'* 


C 

<  — 
h 


1 

¥ 

h  pt 


(  t  f 

Qi  Jo  Jo 
2 


\Div{x  +  s,  y)|  dsdtdxdy 


0  JQ  IJQ 

ph  pt 


fO  JO  IJQ 


\Div{x  +  s,  y)  I  dx  dy  ^  ds  dt 
\DIv\  dx  dy  >  ds  dt 


<Ch  /  \Dfv\. 


We  also  have 


62 


i 

<Ch  [  \D^v\ . 
Jn 


/  /  \D2v{x,y  +  s)\  dsdtdxdy 

Qi  Jo  Jo 


Therefore 


J++iv^)<  f  \Dv\+Ch  f  {\Dlv\  +  \Dlv\). 

Jn  Jn 

By  the  same  argument,  we  have  the  same  bound  for  J_| _ ,  J _ and  J _ , 

J{v^)<  f  \Dv\+Ch  [  i\Dlv\  +  \Dlv\), 

J  Cl  Jci 

where  J  £  {J-| _ ,  J-+,  J__}.  Thus,  we  complete  the  proof.  □ 

Our  goal  is  to  bound  the  difference  between  various  continuous  and  discrete  convex 
functionals  defined  on  L^(0)  and  We  fix  A  >  0.  Given  g  £  L^(0),  we  consider 

the  (unique)  minimizer  u  of  the  functional 


and  the  (unique)  minimizer  of  the  functional 

Eh{v^)  =  -  Ph9\\l^n>^)  + 

where  Jh  is  any  of  the  discrete  variational  functionals  defined  above.  Most  of  our 
analysis  concerns  itself  with  the  special  case 

It  is  difficult  to  compare  u  and  directly,  because  J^{u^)  and  |u|BV(n)  could  be 
far  apart,  in  general,  even  if  ^  u  as  h  —>  0.  However,  there  are  smoothed  versions 
of  u  and  close  to  u  and  u^,  whose  continuous  and  discrete  variations  are  close,  as 
the  following  Lemma  shows. 

Lemma  2.2  (TV  consistency).  There  exists  a  constant  C  such  that  for  any 
discrete  function  G  L^(f2^)  and  any  positive  integer  L  we  have 

I  Int  S'LU^lBv(n)  <  J*(u^)  +  —  J*(u^).  (2-6) 

Furthermore,  there  is  a  constant  C  such  that  for  any  v  G  BV(f2)  and  any  positive  e 
and  any  discrete  functional  Jh,  we  have 

Ch 

Jh{PhSeV)  <  |u|BV(n)  +  — klBvcn)-  (2.7) 

Proof  For  the  first  inequality,  we  have  from  (2.2)  in  Lemma  2.1  (with  Jh  =  J*) 

I  IntS'Lu'*|Bv(n)  <  J*{Slv^)  +  Ch\SLv’^\^2,i 

while  from  (1.32)  in  Lemma  1.7  J^iShV^)  <  J*(u^)  and  (1.39)  in  the  same  lemma 

C  C 

\Slv  liviu(afe)  <  )■ 

The  second  inequality  follows  from  (1.16).  Combining  the  previous  inequalities  gives 

(2.6). 

For  (2.7),  we  have  from  (2.1)  in  Lemma  2.1 


Jh{PhSeV)  <  |‘5e?;|BV(a)  +  Eh\S  1(^20.)  i 


while  (1.33)  yields 


‘5£u|BV(n)  <  l'clBV(n) 


and  (1.38)  gives 


|<S£u|vi/2,i(2n)  <  — klBV(n)- 

Combining  these  three  inequalities  yields  (2.7).  □ 

Now  we  compare  discrete  and  continuous  energy  functionals. 
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Lemma  2.3  (Comparing  discrete  and  continuous  energies).  There  exists 
stant  C  >  0  sueh  that  for  all  Jh  and  for  all  v  £  BV(r2) 

Ch 

Eh{PhSev)  <  E{v)  +  — |?;|BV(n) 

c 

+  y  11^^  -  gWh'^lp.)  (w(u,  /i)l2(o)  +  e)L2(o)  +  Uj{g,  /i)i2(n)) 

c 

+  y  e)L2(n)  +  ^)l2(o))  ■ 

Furthermore,  if  Jh  =  J*,  then  for  all  discrete  functions 

Eilnt  Slv^)  <  Eh{v'^)  + 

c 

+  “  Phg\\L'^(n'')  -^)L2(oh)  +  Uj{g,  ft.)L2(Q)) 

(J 

+  y  (‘^(^^i^)i2(Q)  +  a;(5,  ft.)|2(Q)). 


Proof  We  have 

Eh{PhSev)  =  Jh{PhSev)  +  ^llP/jiSer;  -  P/ig||i2(Qh). 

From  (2.7),  we  see  that  the  first  term  on  the  right  is  bounded  by 

ii'lBV(n)  +  — p|BV(n)- 

Now 

\\PhSeV  -  PhgWl^^Qh)  =  \\IhPhSeV  -  IhPhg\\l2(^n), 
and  the  quantity  on  the  right  can  be  written  as 

\\{IhPhSeV  -  S^v)  +  {S,v  -v)  +  {v-g)  +  {g-  4-P/iff)  111,2(0) 

<  \\v  -  gWh^Q)  +  2\\v  -  g\\L2(^n) 

X  \\{IhPhSeV  -  S^v)  +  {S^v  -v)  +  {g-  IhPhg)\\L^n) 

+  \\{IhPhSeV  —  SeV)  +  {S^V  —  v)  +  {g  —  I/jP^ff)  llL2(n)  ■ 

<  lk-5lli2(o)  +  2||u-g||i2(o) 

X  {\\IhPhSeV  -  5£u||i2(0)  +  \\SeV  -  v||i2(o)  +  Hg  -  hPhgWmQ)) 

+  C{\\IhPhSeV  —  5eZ;||l2(o)  +  \\SeV  —  1^1112(0)  +  \\g  -  IhPhg\\^L^(Q))- 

From  (1.37)  we  can  bound 

\\SeV  -  u||l2(o)  <  Cu;{v,  e)i2(o) 
and  from  (1.24)  we  know  that 


\\IhPhg  -  g\\L^(n)  <  ^^(g, /i)z,2(n). 


a  con- 

(2.8) 

(2.9) 

(2.10) 

(2.11) 
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We  also  have  from  (1.24)  and  (1.35) 


\\IhPh<SeV  -  <  Cuj{SeV,  /i)L2(f2)  <  Cuj{v,  /i)l2(q). 

Thus, 

\\PhS^v  -  Phg\\l2(^Qh)  <  ||v  -  5lli2(n)  +  C\\v  -  gh^Q) 

X  {^{v,  /i)L2(f2)  +  Uj{v,  e)L2(f2)  +  Uj{g,  h)i2(n)) 

+  C (w(u,  ^)i2(Q)  +  uj{v,  e)i2(Q)  +  w(g,  /i)i2(f2))  • 

Using  this  inequality  as  well  as  (2.11)  in  (2.10)  yields  (2.8). 

Now  let  be  any  discrete  function.  Then 

^(Int  S'lz;'*)  =  |Int5Lr;^|Bv(n)  +  ^  II  Int  -  5||^2(n)-  (2.12) 

By  (2.6),  the  first  term  on  the  right  is  bounded  by 

+  (2.13) 

Lj 

Now 

IIInt^L?;^  -ff||i2(n) 

=  ||(Int  Slv^  -  IhSlv^)  +  {IhSlv^  -  hv^) 

+  (IhV^  —  IhPhg)  +  {IhPhg  —  5)IIl2(q). 

<  \\lhv^  -  lhPhg\\\2(p^)  +  ‘2\\lhv‘^  -  lhPhg\\L'^{Q.) 

X  IKlnt^L?;^  -  IhSlv^)  +  {IhSlv^  -  IhV^)  +  {IhPhg  —  5)||l2(o) 

+  WilntSLV^  -  IhSLV^)  +  {IhSLV^  -  hv^)  +  {IhPhg  -  g)\\l^a) 

<  \\IhV^  -  IhPhg\\‘L2(^Q'j  +  2\\IhV^  -  IhPhg\\L^{Q) 

X  (II  IntS'i'y''  -  IhSLV^\\L^(n)  +  WhSLv'^  -  Ihv'^\\L^(Q)  +  \\IhPhg  -  ffllL2(o)) 

+  C(||  Int  11^2(0)  +  ||4^l^^'^  -  4z;1li2(n)  +  114^^5  -  5lli2(n)) 

Since,  for  all  discrete  v^,  ||.f?ii’^’'||L2(Q)  =  ||u^||B2(Qfc),  the  quantity  above  is  bounded 
by 

~  -P?i5llL2(Qh)  +  2||u^  —  Phg\\L^{Q>') 

X  (II  IntS'Li;'*  -  IhSLV^\\L^(^n)  +  \\Slv'^  -  'y^||L2(Qh)  +  \\IhPhg  -  g||L2(o)) 

+  C(||  Int  -  IhSLV^\\l2^n)  +  \\Slv^  -  +  W^Phg  -  gWh^n)) 

From  (1.36)  we  have 

IIS'l?;''  -  v^\\h2(n>')  <  Cuj{v^ ,  L)i^2(^Qhy 
By  (1.28)  and  (1.34)  we  have 

I  Int  Slv^  —  IhSLV^\\L^(Q)  <  Cuj{Slv^,  l)L2(Qh) 

<  l)i2(n).)  <  Ca;(u^,  L)i2(Qfe). 
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Combining  these  inequalities,  we  have 


II  Int  Slv’^  -  5lli2(n)  <  \\v^  - 

+  C\\v^  -  Phg\\L^{Qh-)  -^)L2(n'*)  +  ^{g^  P)L‘^{n)) 
+  C{u}(v^ ,  ^)i2(n)  +  ^{g-<  ^)L2(n))  ■ 


Combining  this  inequality  with  (2.12)  and  (2.13)  yields  (2.9).  □ 

3.  Properties  of  the  continuous  and  discrete  minimizers.  We  need  to 
discuss  some  properties  of  minimizers  of  the  discrete  and  continuous  functionals.  We 
begin  by  comparing  functionals  on  and  and  the  corresponding  functionals  on 
20  and  20^.  We  remind  the  reader  of  the  notations  used  in  Lemma  1.2. 

Lemma  3.1  (Extending  minimizers).  If  is  the  minimizer  of  the  functional 

Ef{v^)  =  En{v^)  =  ^\\v^  -  /||i.(a^)  +  Jf  (u"),  (3.1) 

then  Ext/i  is  the  minimizer  over  all  discrete  functions  defined  on  20^  of  the 
functional 

=  l||r;"  -Ext,/||i.(,^.)  +  J2^'‘(u'‘)  (3.2) 

with  periodic  boundary  conditions. 

Similarly,  if  u  is  the  minimizer  of 

E^{v)  =  E{v)  =  ^||w  -  5||i2(f2)  +  klBV(a)  (3.3) 

then  Ext  u  is  the  minimizer  of 

E'^^{v)  =  ^||u  -  Extg||i2(2n)  +  klBV(2n),  (3.4) 

again  with  periodic  boundary  conditions. 

Furthermore,  if  u  and  w  are  minimizers  of  (3.3)  with  data  g  and  h,  respectively, 
then 


I|m- w[|L2(f2)  <  \\g-h\\L2^Qy, 

similarly  for  the  discrete  and  continuous  minimizers  o/ (3.1)-(3.4).  Thus,  for  the  two 
periodic  problems  (3.2)  and  (3.4)  we  have 

\\ExthU^  -TiExthu’^\\L^(2Q>^)  <  II  Ext/ig'*  -  Tf  Ext/j5^||i2(2n'.)  (3.5) 

and 

||ExtM-T,-ExtM||i2(2n)  <  II  Ext^  -  t;  Extg||L2(2n)-  (3.6) 


Proof.  To  avoid  confusion,  we  use  letters  with  bars  to  indicate  functions  defined 
on  20^b  for  example  v^,  in  the  proof.  Moreover  we  remind  the  reader  for  any  discrete 
function  defined  on  O^,  the  extended  function  Ext/i  is  also  defined  on  20^. 
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Note  that  the  discrete  set  20^  is  the  union  of  four  quadrants, 

4 

=  y 

i=l 

where  fl’l  =  12^  =  O'*  +  {N,  0),  +  (0,  N),n^  =  n^  +  {N,  N). 

For  discrete  functions  defined  on  a  quadrant  A  S  ^2  j  ^3  j  ^4  }>  define 
in  the  same  way  as  defining  Jp  with  Neumann  boundary  condition  imposed.  We 
also  define  Ext?t  the  same  way  as  extending  functions  defined  on  to  7?. 

For  discrete  functions  defined  on  2^^  and  any  quadrant  A,  we  define  the 
discrete  variation  restricted  on  A  of  by 


720'* 

'•'ee 


i^A 


with  ©,  ©  G  {+,  — },  and  the  symmetric  discrete  variation  restricted  on  A  by 

1 


Jf‘  {v^U  =  [r)\A  +  4“  (i;")U  +  rAl  {v'^)\a  +  Ji”  (fi'‘)U). 


For  variations  restricted  on  a  quadrant,  we  use  periodic  boundary  condition  if  the 
values  of  uf  with  i  outside  2^’^  are  needed.  In  fact,  4^  |a  is  only  a  fraction  of  4^ 
where  the  sum  is  taken  over  the  subset  A  of  212^. 

We  point  out  that  we  have  introduced  two  kinds  of  variations  defined  either  on 
a  quadrant  A  or  on  2f2^.  They  use  two  different  boundary  conditions.  4  uses 
Neumann  boundary  condition  that  sets  variation  terms  “across”  the  boundary  zero; 
4^  (or  the  restricted  4^  U)  uses  periodic  boundary  conditions  that  assumes  the 
values  of  are  periodically  extended  to  1?  with  period  (2N^  2N). 

Moreover,  we  define  the  corresponding  functional  restricted  on  A  by 


Ef  {v'^)\a  =  JT 


-  Ext 


/.4114(A)- 


Similarly  is  a  fraction  of  E'^’^  where  the  sum  is  taken  over  A.  Thus  it  is 

trivial 


Y.EI^\v’^)\^u  =  El^\v^),  (3.7) 

Z=1 


At  last  for  any  defined  on  212^,  we  use  v\a  to  indicate  a  discrete  function 
defined  on  A  that  equals  restricted  on  A. 

We  show  that 


JHAa)  <  J^.^\v’^)\a, 

and 

e^{Aa)<eA{A\a, 

This  is  because,  letting  the  boundary  of  A  to  be  the  set 


(3.8) 


(3.9) 


dA  ■=  {{ii,i2)  I  *1  ori2  S  {0,N  -  1,N,  2N  -  1}}, 
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and  Jtiv’^U)  both  include  the  sum  of  variation  terms  at  inner  points 
of  A,  i.e.,  A  \  dA]  for  the  sum  taken  over  dA  where  variations  include  differences  of 
at  points  both  inside  and  outside  A,  (11^)  U  assumes  outside  A  satisfies 
periodic  boundary  condition,  while  simply  assumes  such  differences  equal 

zero.  Hence  we  get  (3.8).  (3.9)  is  a  straightforward  deduction  of  (3.8). 

Note  that  for  the  extended  function  Ext^  of  that  is  defined  on  a  quadrant, 
these  equations  hold  due  to  the  reflection  in  extending. 

=  Jf'''‘(Exk /'‘)|oh,  1  <  f  <  4  (3.10) 

iff  (Ext;,/'*|nj.)=Ef'‘(Ext;,/'*)|oj..  l<i<4  (3.11) 

Also  by  the  symmetric  nature  of  and  the  definition  of  Ext/i,  it  is  trivial 

(Ext„  f%H)  =  J$  it)  1  <  j  <  4,  j  ^  *  (3.12) 

and 

II  ExU/^  -  Ext,^/||i2(o^)  =  ||ExU/^ -Ext,»/||i2(oh).  1  <  j  <  4,  *  (3-13) 

Therefore,  on  any  quadrant  1  <  *  <  4,  the  minimization  problem 

arg  min  E^'  (w^)  =  arg  min  (w^)  +  ;^||w'‘  -  Ext?,  g^\\l2(Qh) 

u;'‘eL2(n'*)  uj'*GL2(a'>)  ^  "  2A " 

has  a  unique  solution  Ext?,  because  for  any  discrete  function  defined  on 

(w^)  + 

=  jf'* ((Ext?,  u;^)|nh)  +  ^11  Ext ?,«;'" -/II ^2(0).)  by  (3.12)  and  (3.13) 

>  (m^)  +  —  ||m^  -  5^||^2(Qh) 

=  {(Exthu’")\nh)  +  ^11  Ext?,  -  Ext?,g^||^2(j.2'*)-  by  (3.12)  and  (3.13) 
Thus  for  any  discrete  function  defined  on  20^, 

Ep{Extf,u%.)  <  Ef{v%.).  1  <  *  <  4 

Adding  this  inequality  for  i  =  1,  2, 3, 4  and  noting  by  (3.11) 

4 

E?  (Ext?,  u'*  In. )  =  Ef "  (Ext?,  u'^) , 


we  have 


£;f'*(Ext?,u'')<y]£;f  (fi^lf,.). 

2=1 
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For  each  term  on  the  right  hand,  by  (3.9) 


Then  adding  them  all,  we  have  for  any  discrete  function  defined  on  2^^, 

'  (Ext;,  In?  =  by  (3.7) 

2=1 


i.e.,  Extft  is  the  minimizer  of  the  functional  (3.2). 

The  second  part  is  the  continuous  analogue  of  the  discrete  case.  And  the  last  two 
inequalities  are  standard.  □ 

The  next  lemma  is  classical. 

Lemma  3.2  (Smoothness  bounds).  Assume  u  is  the  minimizer  of  the  functional 

^  ^11^  “  3llL2(n)  +  klBV(a) 
and  is  the  minimizer  of  the  discrete  functional 

Eh{v^)  =  ^\\v^  -  PhgWl^n-)  + 

Then 


11^^  -  ffllL2(n)  <  ||ff||L2(n)  (3-14) 

and 

-  Phg\\L'^(Q.>^)  <  \\Phg\\L'^{nf')  <  ll5llL2(n)-  (3.15) 

Additionally,  we  have 

|M|BV(n)  <  ^I|5IIl2(q)  (3.16) 

and 

Mu^)  <  l^WPugWl.^a-)  <  ^Il5lli2(0).  (3.17) 

ITe  also  have 

‘^(M,e)L2(o)  <  Cu;(g,e)L2(Q)  (3.18) 

and  if  Jh  =  J*  then 

uj{u^ ,  L)L2(^Qh)  <  Cuj{Phg,L)j^2(^Qh-^  <  Cuj{g,  Lh)i^2(^Qy  (3.19) 


Proof.  The  results  are  classical,  but  some  of  the  proofs  are  short,  so  we  give  them 
here. 

We  know  that  E{u)  <  E(0),  so 

-  3lli2(n)  ^  ^11’“  “  9\\l^{q)  +  l^lBV(n)  <  ^llffllL2(n)- 
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One  proves  (3.15)  in  the  same  way. 

Inequalities  (3.16)  and  (3.17)  follow  from  E{u)  <  E(0)  and  Eh{u^)  <  Eh{0), 
respectively. 

For  inequality  (3.18),  by  definition 


By  (3.6) 


<  Cuj{g,  e)L2(2n). 


The  last  line  follows  from  (1.4)  of  Lemma  1.1. 

It  is  similar  to  prove  the  left  part  of  (3.19)  by  using  the  definition  of  uj{u^ ,  L)^2(Qh) 
and  applying  (3.5)  and  (1.5).  The  right  part  of  (3.19)  is  just  (1.21).  □ 

4.  Proof  of  the  main  theorems.  We  now  bound  the  difference  between  dis¬ 
crete  and  continuous  functionals  at  their  respective  minimizers. 

Theorem  4.1  (Functional  difference).  Assume  u  is  the  minimizer  of  the  func¬ 
tional 


for  g  G  Lip(a,  L^(i7))  and  is  the  minimizer  of  the  discrete  functional 


Eh{v^)  =  ^\\v'^-Ph9\\hin^)+JM)- 


Then  if  e  =  we  have 


EhiPhS^u)  <  E{u)  +  y 


(4.1) 


and  if  L  is  set  to  the  integer  part  of  h  “/(“+i)  then 


EilntSLu'^)  <  Eu{u^)  +  y||5|lLp(a,L=(0))^“/^“+'^ 


(4.2) 


Finally, 


(4.3) 


Proof.  We  mainly  use  Lemma  2.3  and  Lemma  3.2.  By  (2.8)  of  Lemma  2.3 


Eh{PhSeu)  <  E{u)  H - |M|BV(n) 

c 

+  yll“-5llL2(n)(‘^(M,/i)L=(a)  e)L=(a)  +  ^^{g^EjL^in)) 

c 

+  y  ('^(^7  P)L^{n)  +  '^(^7  P}L^{n)  +  ^{9^ 
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We  then  apply  (3.14),  (3.16),  and  (3.18)  to  obtain 

Ch 

Eh{PhSeu)  <  E{u)  +  -^||5||i2(n) 

C 

+  +  07(3, /i)i2(n)) 

C 

+  y  (^(5j  ^)i2(n)  +  e)i2(n))- 

Since  g  G  Lip(Q;, L^(n)), 


^{g,t)L'^{Q)  <  lff|Lip(a,L2(n))t“,  t  >  0. 

Thus 

Ch 

Eh{PhSeu)  <  E{u)  +  -^||ff||i2(n) 

C 

+  y  ll5llL2(n)|5|Lip(a.L2(n))(e“  +  h“) 

+  y  l5lLip(a,L2(n))(£^“  + 

<  E{u)  +  y  ||ff||Lip(a.L2(n))(“  +  e“  +  +  e^“  +  h^“) 

We  know  at  a  minimum  1  >  e  >  h,  so  setting  the  largest  error  terms  h/ e  and  e“  equal, 
i.e.,  setting  e  =  h}E°‘^^\  we  have 

Eh{PhS.u)  <  E{u)  +  y  ||5llLp(a.L=(n))(^“/^“+'^  +h^  + 

Thus  we  obtain  (4.1). 

We  point  out  that  (4.1)  holds  for  any  discrete  variation  defined  in  (1.9).  More 
generally  it  holds  for  any  discrete  variation  satisfying  Lemma  2.2. 

Similarly,  if  one  begins  with  (2.9)  and  applies  (3.15),  (3.17),  and  (3.19),  one  finds 
on  setting  L  to  the  integer  part  of  that 

if(Int5i«")  <  i?,(«'^)  +  y||5|lLp(a,L=(0))^“/^“+'^ 

which  is  (4.2). 

Because  u  and  are  minimizers  of  their  respective  functionals,  we  have 

Eh{u>^)  <  EhiPhS^u)  <  E{u)  +  j  ||5llLp(c.L^(0))^“/^“+'^  (4.4) 

and 

E{u)  <  E{lniSLU^)  <  En{u^)  +  y ||5llLp(c.L=(0))/i“/^“+'^.  (4-5) 

Then  (4.3)  is  proved.  □ 

To  show  the  error  bound  for  minimizers,  we  need  the  following  result,  which  can 
be  proved  easily  using  classical  arguments. 

Lemma  4.1.  If  u  is  the  minimizer  of  the  functional  E{v)  defined  in  Theorem  4.1, 
then  for  any  v  €  BV(n) 

Ik  -  w|Ii,2(q)  <  2A(P(v)  -  E(u)). 
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(4.6) 


Moreover,  if  is  the  minimizer  of  Ei,^{v^),  then  for  any  defined  on 


\\v^  -  <  ‘^KEniv^)  -  Enin^)).  (4.7) 

Theorem  4.2  (Minimizer  difference).  Assume  u  is  the  minimizer  of  the  func¬ 
tional 

E{v)  =  ^11''^  “  5lli2(n)  +  klBV(O) 

for  g  G  Lip(a,  L^(i7))  and  is  the  minimizer  of  the  discrete  functional 

Eh{v>^)  =  j^\\v'^-Ph9\\l2^n'^-,  +  jM)- 

Then 

\\IhU^  -u||^2(Q)  <  C'||5llLp(a.L2(n))^“'^^“~'’^^- 

Proof.  We  apply  (4.7)  with  =  PhS^^u  and  e  = 

\\PhS,u  -  <  2X{EhiPhSeU^)  -  Ehiu^)) 

<2A[(if(ri)  +  ^||g||Lp(„,i2(n))/i“/(“+')) 

+  i-E{u)  +  —  [|5llLp(a.L2(n))^“^*'“"'’^^)]  • 

The  first  substitution  is  by  (4.1);  the  second  is  by  (4.5).  Thus  we  have 

WPhS^u  -  u'‘||i2(o.)  <  C'||5||Lp(a.L2(n))/i“/^“+'^-  (4.8) 

Then 

114m'*  -  M||i2(Q)  =  114m'*  -  IhPhSeU  +  hPhSeU  -  S^U  +  S^u  -  M||^2(n) 

<  3(||//jm'*  —  IhPhSeU\\\2(p^^  +  \\IhPhSeU  —  ‘5eM|||2(Q) 

+  \\SeU  -  m|||2(q)) 

We  note  by  (1.22)  and  (4.8) 

\\hu>^  -  hP,,SM\hin)  =  11^2(0.)  <  4||3||Lp(„,z,2(n))/i“/(“+'). 

To  bound  \\IhPh<SeU  —  5£u[|i2(Q),  by  (1.24),  (1.35),  and  (3.18),  we  have 

\\IhPhSeU  -  SeU\\L^(^Cl)  <  C  LO  {S  ,  h)  ^2  (4.9) 

<  Cuj{u,h)L2(^a)  <  Cuj{g,h)L2^Qy 

Finally  by  (1.37)  and  (3.18) 

||5eU  -  M||i2(Q)  <  Cu;{u,  e)  <  Cuj{g,  e). 
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(4.10) 


Thus  combining  (4.8),  (4.9)  and  (4.10),  we  have 
Wlhu’^  -  w|li2(n)  <  C  +  ^{g,  ^1,2(0)  + 

Because  the  first  term  dominates  the  others,  we  have 

\\IhU*^  -  M||i2(Q)  <  C'||5llLp(a.L2(n))/i“^^“~'’^^- 

□ 


5.  Error  bound  for  the  upwind  scheme.  In  this  section,  we  prove  the  error 
bound  for  the  “upwind”  scheme.  The  “upwind”  discrete  gradient  operator  —  is 
defined  by 

Ext/,  uf  -  Ext/,  ?^f+(i,o) 

/_V  \„h  =  1  ~  ""*-(1.0) 

^  ^  h  Ext/,uf  -  Ext/,-yf_^(o^^) 

Ext/,  v'^  -  Ext/, 

The  “upwind”  discrete  variation  is  then  defined  by 

Ju{v’^)=  E  |(-V/,)^;f  V0|/i2 

ien'* 

where  0  is  the  vector  (0,  0, 0, 0),  and  p  V  g  and  pAq  are  componentwise  maximum  and 
minimum,  respectively,  of  the  vectors  p,  g  S  K^. 

In  other  words,  we  include  a  difference  in  the  vector  norm  of  the  ith  term  in  (5.2) 
only  if  is  increasing  into  uf .  Nothing  changes  in  the  following  proofs  (and  one  sees 
little  change  in  the  images  themselves)  if  we  change  componentwise  maximum  (V)  to 
componentwise  minimum  (A)  in  (5.2).  In  their  paper,  Osher  and  Sethian  [12]  were 
solving  Hamilton-Jacobi  equations  where  this  substitution  could  not  be  made:  their 
problem,  unlike  ours,  has  a  true  notion  of  “wind” . 

To  prove  the  result  for  the  “upwind”  scheme,  we  need  to  adapt  to  Ju  the  previous 
lemmas  involving  J*. 

First  we  shall  prove  the  convexity  of  Jjj. 

Lemma  5.1.  Ju  is  convex 

Proof.  First  note  that  for  two  vectors  p,q  €  M",  it  is  easy  to  verify 
0<  (p  +  g)V0<pV0  +  gV0, 
where  inequality  p  <  q  means  p/  <  qi  for  each  index  i.  Thus, 


\ 

/ 


(5.1) 


(5.2) 


|(p  +  g)  V  0|  <  Ip  V  0|  +  |g  V  0|. 


(5.3) 


We  apply  (5.3)  to  each  term  in  (5.2)  of  Ju  (A/^  +  (1  —  A)g^)  ,  where  1  >  A  >  0 
and  and  are  discrete  functions,  to  find  that 


Ju  (A/'^  +  (1  -  A)g'‘)  =  ^  |(-V/,)(A/'‘  +  (1  -  A)g'^),  V  0| 

i 

<  E  V  0|  +  1(1  -  A)(-V/,)gf  V  0| } 

i 

=  \Ju{f)  +  {i-\)Ju{g'^). 
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□ 

In  the  following  we  use  the  notation  and  defined  in  (2.3).  We  define 
similarly 


Vu'*  = 


Ext/i  uf  -  Ext/j 


0) 


= 


Exth  uf  -  Ext/i  v^ 


(0.1) 


(5.4) 


Note  that  the  divided  differences  are  applied  to  the  extended  discrete  function  and 
that  the  difference  is  zero  if  i  £  12^  and  the  other  index  is  outside 
Using  these  operators,  we  can  write 


Juiv'^)  = 


ien'* 


/  -V+uf  VO  \ 
Vj,  Vi  V  0 
-V+?;f  V  0 

VO ; 


(5.5) 


The  following  lemma  corresponds  to  Lemma  1.3. 

Lemma  5.2.  Jjj  is  equivalent  to  \  ■  Iwi’i(n'i),  where  \  ■  Iwi’i(n'i)  *5  the  discrete 
seminorm  defined  in  (1.14).  More  precisely, 

2  1^  lvEui(n'*)  —  )  <  \v  (5-6) 


Proof.  By  (1.15) 

^  E{  V  0|  +  I  V-uf  V  0|  +  |-V>f  V  0|  +  I  V  0| } 

i 

<  ^  J V  0|^  +  jVxuf  V  0|^  +  |-Vy  uf  V  0|^  +  |Vy  uf  V  0|^| 

i 

^  V  o|  +  |v-uf  V 0|  +  |-V>f  V 0|  +  \V-v'l  V 0|} 

i 


The  middle  sum  is  Ju{v^),  so  we  need  to  prove  that  the  last  sum  equals  lii^lrvuqn'*)- 
Note  that 


|-V+r;f  V0|  + 


'l’i+(l,0)  ^  0 


-V+uf  V0|  +  |V+uf  V0|  =  |V+uf|, 


so  the  absolute  value  of  each  horizontal  and  vertical  difference  in  is  included  pre¬ 
cisely  once  in  the  last  sum,  so  it  equals 


The  following  lemma  corresponds  to  Lemma  1.4. 
Lemma  5.3. 


I  Jc/(ii'‘)  -  Jee('y'*)|  <  h  |ExU  r;'‘|^2,i(2Qh)  (5.7) 

where  J^q  is  any  discrete  variation  defined  in  (1.8). 

Proof.  We  only  prove  the  case  for  J^q  =  J++.  The  other  cases  are  the  same. 
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Note  that 


so  we  can 


|V+z;f  P  =  |V+^f  V  Op  +  V  Op, 

write  in  a  similar  way  to  Jij{v^)  as 


J++{v^)  = 


ieo'* 


/  -vtv^yo  \ 

V+i;f  V  0 
-V+v'l  V  0 

V  v>fvo; 


Thus, 


\Ju{v>^)-J+M)\  = 


(  -v+uf  VO  \ 
V~v^  V  0 
-V+v'l  V  0 


f  VO  y 


—  ■ 


/  -V^^;yvO  \ 

V+Vi  V  0 
-V+v'l  V  0 

V  v+ufvo; 

\ 


— -,/i 


V0-V+r;fv0  / 


V  0  -  V+z;f  V  0|  +  |  V"?;''  V  0  -  V  0| ) 


Because  |a  V  0  —  6  V  0|  <  |a  —  6| ,  we  have 

\Ju{v^)  -  J++{v'^)\  <  Y.  ( -  V+z;f  I  +  \V-v'l  -  I  )/i2 

ien** 

□ 

We  use  Lemma  5.2  and  Lemma  5.3  to  prove  the  following  lemma  that  corresponds 
to  Lemma  2.1. 

Lemma  5.4.  There  exists  a  C  >  0  such  for  any  v  £  L^(n) 

Ju{Phv)  <  PlBV(n)  +  C/il  Ext  r;|u/2, 1(20)  (5-8) 

and  for  any  defined  on 

Intz;'‘|Bv(n)  <  +  C/il  Ext/^  ?;'‘|,^2,i(20fc)-  (5-9) 


Proof.  The  second  inequality  can  be  proved  by  simply  combining  (2.2)  and  (5.7). 
To  prove  the  first  inequality,  again  we  assume  that  Extri  G  otherwise 

it  is  trivial.  We  apply  Lemma  5.3  with  =  PhV,  then 

Ju  ^  *^00  (L)ju) -f  Ext/i  I ^2,1  ^20^)  ■ 

Then  by  (2.1)  in  Lemma  2.1 

JuiPh'^)  ^  l’^lBV(n)  T  Ext/;,  1^20^) 

~  PlBV(n)  +  C’ft-I  Ext  1(20)  +  C'/i|P/i  Ext  u|^2, 1^20'*) 

—  PlBV(n)  +  C'/i|  Ext  u|b^2, 1(20)- 
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The  last  line  follows  from  (1.25).  □ 

Lemma  5.5  is  the  counterpart  of  the  first  inequality  (1-32)  in  Lemma  1.7. 
Lemma  5.5. 


Ju{Slv^)  <  Ju{v^). 


(5.10) 


Proof.  The  result  comes  from  the  symmetry  and  convexity  of  Jjj.  The  proof  is 
exactly  the  same  as  the  proof  for  J*  in  Lemma  1.7.  □ 

We  note  that  the  proofs  of  Lemmas  3.1  and  4.1  carry  over  directly  to  Jjj,  and  we 
obtain  the  following  theorem  for  the  “upwind”  discrete  variation. 

Theorem  5.1  (Error  bounds  for  upwind  scheme).  Assume  u  is  the  minimizer  of 
the  functional 

^  “  3llL2(n)  +  klBV(a) 

for  g  G  Lip(a,  L^(r2))  and  is  the  minimizer  of  the  discrete  functional 
EH{v^)  =  ^\\v^-PH9\\l2^n^)+Mv^)- 

Then 

The  proof  is  the  same  as  the  proof  for  the  symmetric  discrete  variation  J*. 

6.  Conclusions  and  extensions.  We  have  proved  error  bounds  for  discrete 
minimizers  of  two  symmetric  approximations  to  the  ROE  image  smoothing  model. 
We  remark  that  our  bounds  are  not  “optimal”  in  an  approximation-theory  sense,  as 
one  can  approximate  Lip(Q!,  L^(f2))  functions  in  to  order  h°‘  and  we  achieve  an 

error  bound  of  ^  This  bound,  coincidentally,  coincides  with  the  rate  of  noise 

removal  using  linear  methods  applied  to  wavelets,  see,  e.g.,  [4].  (The  resuls  stated 
there  are  for  functions  in  W“’^(S2),  but  they  use  only  inequalities  that  are  equally 
true  for  Lip(a,  L^(r2)).) 

Somewhat  weaker  results  were  proved  by  the  first  author  in  [14]  for  the  functional 

The  arguments  there  exploit  the  fact  that  for  this  particular 


I  Intu^’'|Bv(n)  =  Jh{v^)\ 

they  also  require  that  g  €  Lip(/3,  L^(f2))nL°°(S2),  which  implies  that  g  €  Lip(Q!,  L^(r2)) 
for  a  =  /3/2,  and  they  achieve  the  same  convergence  rate  of  _ 

Finally,  similar  techniques  have  been  applied  to  analyze  a  central  difference  ap¬ 
proximation  to  |u|bv(0)  in  [11];  there  the  same  convergence  rate  of  approximation 
0{h^/'^){a  =  1)  was  achieved,  but  for  quite  smooth  functions:  g  is  required  to  be  in 
the  Sobolev  space  VF^’^(n),  a  space  that  does  not  contain  “images  with  edges”. 
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